19950505  142 


KALMAN  FILTER  MODELS  FOR  EXTRAPOLATIONS  IN 
DOSE-RESPONSE  EXPERIMENTS  AND  ACCELERATED  LIEE-TESTS 

by 

Nozer  D.  Singpurwalla 


GWU/IRRA/Serial  TR-88/4 
9  September  1988 


The  George  Washington  University 
School  of  Engineering  and  Applied  Science 
Institute  for  Reliability  and  Risk  Analysis 


Research  Sponsored  by 

Contract  N00014-85-K-0202 
Project  NR  042-372 
Office  of  Naval  Research 

and 

Grant  DAAL03-87-K-0056 
U.S.  Army  Research  Office 


DISTRIBUTIOLI  STAfEMEKt'  A 


Approved  fv-;r  public  release; 
Disbribu.tic-n  Uvi.li;aiited 


KALMAN  FILTER  MODELS  FOR  EXTRAPOLATION  IN 
DOSE-RESPONSE  EXPERIMENTS  AND  ACCELERATED  LIFE-TESTS 

by 

Nozer  D.  Singpurwalla 
The  George  Washington  University 
Washington,  DC  20052 

Abstract 

Kalman-Filter  models  with  Gaussian  innovations  provide  a  useful  and  easy  to 
implement  tool  for  inference  from  dose-response  experiments  and  accelerated  life- 
tests.  Their  main  advantage  stems  from  the  fact  that  the  system  equation  of  such 
models  alllows  for  the  uncertainty  and  possible  changes  in  a  proposed  dose-response 
relationship.  This  is  in  contrast  to  the  currently  used  approaches  wherein  there  is 
an  implicit  commitment  to  the  validity  of  an  assumed  relationship.  In  this  paper,  we 
overview  our  recent  work  in  the  above  general  area  and  suggest  avenues  for  future 
research. 


1.  INTRODUCTION 


In  its  simplest  form,  a  Kalman-Filter  model  relates  an  observed  value  \  ^  at 
time  t,  t  =  l,  2,...,  to  an  unknown  (vector  or  scalar)  quantity  6^  --  the  state  of 
nature  —  via  the  observation  equation  0^  T  r^,  where  Fj^  is  a  known 

coefficient  and  {r|.}  a  sequence  of  innovations  assumed  to  be  Gaussian  with  known 
parameters.  What  distinguishes  a  Kalman-Filter  model  from  the  standard  regression 
models,  is  the  consideration  of  a  system  equation  wherein  0^  is  related  to  its 
previous  value  0^  via  the  relationship  0^  =  +  w^,  where  is  a  known 

coefficient  and  {w^}  a  sequence  of  uncorrelated  innovations,  assumed  Gaussian  with 
known  parameters.  Furthermore,  the  w^’s  are  contemporaneously  uncorrelated  with 
the  r^’s.  Given  the  observations  Yp  Y2,...,Y^,  the  Kalman-Filter  algorithm  enables 
us  to  obtain  the  posterior  distribution  of  0|.  in  a  recursive  manner.  The  algorithm 
is  started-off  by  specifying  the  mean  and  the  covariance  of  the  prior  distribution 
of  00-  Literature  on  Kalman-Filter  models  and  algorithms  for  the  efficient 
computation  of  the  posterior  distribution  of  0^,  under  various  scenarios  and 
generalizations  of  the  above  theme,  is  typically  available  in  the  engineering  and 
control  theory  journals.  Statisticians  have  recently  become  interested  in  such 
models,  and  a  possible  source  of  introduction  is  the  expository  paper  by  Meinhold 
and  Singpurwalla  (1983). 

The  accelerated  life-testing  set-up  can  be  best  described  via  the  following 
scenario:  we  are  given  stresses  (or  doses)  >  S2  ...  >  and  under  Sj  an 

item  has  life-length  T-,  with  the  Tj’s  assumed  stochastically  increasing  in  j.  Given 
the  observed  realizations  of  Tp  T2,.-.,T^,  we  need  to  make  statements  of 
uncertainty  about  T^_^p  we  may  or  may  not  have  realizations  of  Y^^P  It  is  common 
-  though  rather  restrictive  -  to  assume  that  Tj  has  an  exponential  distribution 


An  important 


with  a  mean  0j,  and  so  what  is  desired  is  inference  about 
ingredient  for  inference  about  given  the  realizations  of  Tp...,T^  (and  perhaps 

is  a  relationship  (or  model)  which  connects  the  0’s  and  the  S’s.  Such  a 
relationship  is  referred  to  as  a  time  transformation  function,  and  the  choice  of  such 
functions  should  be  dictated  by  considerations  embedded  in  the  physics,  the 
chemistry  or  the  biology  of  the  failure  generating  mechanism.  This  is  an  issue 
which  calls  for  collaboration  between  statisticians  and  their  colleagues  in  the 
engineering  and  the  natural  sciences  and  presents  an  opportunity  for  meaningful  new 
work  in  accelerated  life  testing.  The  current  literature  on  accelerated  life  testing 
focuses  attention  on  two  commonly  used  time  transformation  functions,  both  of 
which  appear  to  have  a  naive  physical  basis.  These  are,  the  Power  Law,  under 

4>  ■ 

which  0j  =  and  the  Arrhenius’  Law,  under  which  0j  =  exp(aj -f  «lij/Sj),  where 

aj  and  are  unknown  constants  -  see  Mann,  Schafer  and  Singpurwalla  (1974), 
p.  421.  Notwithstanding  the  comment  that  the  above  two  relationships  may  have  a 
naive  physical  basis,  there  is  also  some  concern  that  the  validity  of  these 
relationships  may  not  hold  over  the  entire  range  of  the  stresses.  High  values  of 
the  stress  may  trigger  a  change  in  the  basic  failure  generating  mechanism  calling  for 
different  time  transformation  functions  over  different  ranges  of  the  stress.  Casting 
the  time  transformation  function  as  the  system  equation  of  a  Kalman-Filter  model, 
enables  us  -  via  the  innovation  terms  w^  -  not  only  to  incorporate  a  measure  of 
uncertainty  about  the  time  transformation  function,  but  also  to  better  track  changes 
in  such  functions. 

The  dose-response  and  the  damage  assessment  scenarios  that  are  of  interest 
to  us  here,  can  be  described  as  follows;  we  are  given  a  dose  (or  stress)  say  X,  with 
X  taking  values  x  ■,  j=l,...,T,  and  X:  c  [0,  oo].  We  may  or  may  not  be  able  to 
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control  the  values  x  precisely,  and  under  each  x,  we  are  able  to  test  one  or 
specimens  of  an  item  of  interest.  Let  Y(Xj)  denote  the  response  under  dose  x^  and 
let  Y(x  )  e  (0,  1);  for  example,  Y(x,)  could  represent  the  proportion  of  items  damaged 
or  the  extent  of  damage  to  a  particular  item.  We  assume  that  the  response  is  a 
nonlinear  function  of  the  dose;  specifically  E(Y{x))  =  exp(— a(x)x^  ),  where  a,(x) 
and  pU)  are  unknown  constants.  The  above  relationship,  which  resembles  the 
survival  function  of  a  Weibull  distribution,  is  like  the  time  transformation  function 
of  accelerated  life  tests.  It’s  key  advantages  are  that  it  can  be  easily  linearized 
and  that  it  is  flexible  enough  to  represent  many  shapes  that  are  candidates  for 
describing  the  relationship  between  the  dose  and  its  response.  Given  the  Xj  s  and 
their  associated  Y^’s,  j=l,...,T,  our  aim  is  to  make  inferences  about  (x(x)  and  ^(x) 
and  use  these  to  assess  our  uncertainty  about  YCxq)  for  any  Xq  ^  Xj. 

2.  KALM.A.N-FILTER  MODELS  FOR  ACCELERATED  LIFE-TESTS 

We  have  proposed  two  strategies  for  inference  from  accelerated  life  tests, 
using  Kalman-Filter  models.  The  first  one,  described  in  Meinhold  and  Singpurwalla 
(1984),  is  applicable  when  a  large  number  of  items  are  tested  to  failure  at  each 
stress  level.  Its  main  advantage  is  computational,  since  it  results  in  a  direct 
application  of  the  Kalman-Filter  algorithm  with  serially  uncorrelated  innovations  for 
the  observation  equation.  The  second  one,  described  in  Blackwell  and  Singpurwalla 
(1988),  is  applicable  for  smaller  sample  sizes  but  requires  a  computationally  more 
intensive  effort,  since  the  resulting  observation  equation  of  the  Kalman-Filter 
contains  serially  correlated  innovations.  Engineers  refer  to  Kalman-Filter  models 
with  correlated  innovations  in  the  system  equation  as  filtering  in  coloured  noise. 

We  shall  first  outline  the  former  of  the  above  two  strategies. 
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strategy  1-  Suppose  that  items  are  tested  to  failure  under  stress  Sj,  and 
let  X  be  the  sample  mean  of  the  n:  observed  life-lengths.  Let  Yj  =  —  log  Xj;  then 
it  can  be  shown  that  the  cumulants  of  approach  those  of  a  Gaussian  distribution, 
suggesting  that  the  observation  equation  of  a  Kalman-Filter  be  formulated  in  terms 
of  Yj.  Specifically,  we  let  Zj  =  log  n-  -  rDin^)  -  Yj,  where  ?C(nj)  is  the  digarama 
function,  write  the  observation  equation  of  the  Kalman-Filter  as  Zj  —  log  0j  -F  rj, 
and  argue  that  r-  ~  .N-CO,  l6'(nj)),  where  ^(nj)  is  the  first  derivative  of  the  digamma 
function;  the  notation  “X  ~  ct)”  denotes  the  fact  that  X  has  a  Gaussian 

distribution  with  mean  and  variance  <t.  The  sequence  of  innovations  r^  •••  ,r^, 
are  assumed  to  be  uncorrelated.  The  above  form  of  the  observation  equation  is 
motivated  by  the  fact  that  and  K2,  the  first  and  the  second  cumulant  of  the 
distribution  of  Yj,  given  0j,  are  of  the  form  Kj  =  lognj  -  log0j  -  and  K2 

=  nn^). 

For  the  system  equations  of  the  Kalman-Filter,  we  argue  that  the 
.Arrhenius  and  the  Power  Law,  suggest  the  general  form 

log  0j  =  log  0j_j  -F  h(Sj,Sj_p  +  Uj,  and 
0j  =  <^j_i  +  Vj,  with 

the  vector  [u  •,  v  ]  ~  J^(0,  S ;),  where  Z  -  is  the  covariance  of  u  =  and  v :  under  stress 

j  J  J  J  j  j 

j,  h(s  ,  s  -  ,)  is  of  the  form  (S'.^  —  S'Jj  for  the  Arrhenius  Law,  with  Uj  =  Vj/Sj  p 
and  of  the  form  log(Sj/Sj_j)  with  Uj  =  Vjlog(S'lj)  for  the  Power  Law.  Since  Uj  and 
Vj,  the  components  of  the  innovation  term  of  the  system  equations  are  related  to 
each  other,  we  may  write  Uj  =  /SjVj  -F  Wj  is  an  innovation  that  is  independent  of 
Vj  and  0j  =  Sj^i  (log  for  the  Arrhenius  (Power)  Law.  It  now  follows  that  for 
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J- 1,  t, 


V  .  = 


Var(Vj)  +  Var(Wj)  /3j  Var(vj) 


Var(vj) 


Var(vj) 


To  use  the  above  scheme  as  a  system  equation  of  the  Kalman-Filter,  we  must 
specify  Var(v  ),  Var(w:)  and  the  starting  values  0o  ^o-  quantity  Var(Wj) 

reflects  our  faith  in  the  constancy  of  the  prescribed  Law  (Arrhenius  or  Power)  in 
going  from  one  stress  level  to  another,  whereas  the  quantity  Var(wj)  specifies  our 
faith  in  the  validity  of  the  prescribed  Law.  Once  the  above  have  been  done,  an 
implementation  of  the  Kalman-Filter  algorithm  is  straightforward. 


Strategy  2.  For  purposes  of  discussion,  we  focus  attention  on  the  j-th  stress 

level,  and  suppose  that  <  Tj2  <  •••  <  are  the  ordered  times  of  failure  of 

the  n  items  tested  under  Sj;  that  is  Tjj^,  k=l,  ...  ,  n  are  the  order  statistics  of  Ty 

Let  be  the  realization  of  T It  is  well  known  that  Gj(u),  the  survival  function 

of  T  ,  is  given  by  Gj(u)  =  exp(-J^  hj(u)du),  where  hj(  )  is  the  failure  rate  of  Ty 

Let  Hj(u)  =  hj(s)ds,  then  under  the  Power  Law  0j  —  cxjSj  ,  Gj(Tjj^) 

^  - 

=  expl— H(Tjj^)]  =  exp[— ajSj  ^  Tjj^l.  The  above  motivates  us  to  define  y*j^  =  log 
t-y,  Fj  =  (-1,  -log  Sj),  CLjy  =  (log  Oiy  ■),  v*-y  =  log  {-log  Gj  (Tjj^)h  and 

consider,  as  a  model  of  observations  yj^  =  ^jk’  ^jk  ^jk 

E(v*j,)  and  Vj^  =  v*j^  —  E(Vjj^).  Since  the  distribution  of  v'j^^  is  known  —  note 


that  Gj(tjj,)  has  a  beta  distribution  —  the  quantity  E(vjj^)  is  known.  Even  though 
we  know  the  distribution  of  Vjj^,  we  are  unable  to  analytically  assert  that  it  is 
Gaussian.  However,  some  empirical  work  suggests  that  the  assumption  of 
Gaussianity  for  Vjj,  is  reasonable  when:  n  is  as  small  as  10  and  k  close  to  n;  n  is 
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greater  than  10  and  k  moderate  to  large;  n  is  greater  than  25  and  k  as  small  as  6.  It 
should  also  be  clear  that  the  Vjj^’s  are  correlated  for  k=l,  n,  and  that  the 
correlations  are  known;  this  information  should  be  incorporated  in  the  filtering 
algorithm. 

For  the  system  equation,  we  propose  the  steady-model  of  Harrison  and 
Stevens  (1976);  that  is 

D’  observed  failure  is 

a  ju  = 

l)k  observed  failure  is 

Gj  is  a  2x2  identity  matrix  and  Wj^,  =  (wjjk’  ’*^2,jk^'  innovations  Wj  and 

are  assumed  to  be  independent  and  Gaussian  with  mean  0  and  covariance 
assumed  known.  The  entries  for  reflect  our  faith  about  the  constancy  of  aj 
and  in  going  from  one  stress  level  to  the  other.  A  computer  program  which 
implements  the  filtering  algorithm  under  the  above  scheme  has  been  used  by  us  on 
data  from  a  realistic  scenario  and  also  some  simulated  data;  the  details  can  be  found 
in  Blackwell  and  Singpurwalla  (1988). 

3.  A  KALMAN-FILTER  MODEL  FOR  DOSE-RESPONSE  EXPERIMENTS 

Following  the  notaiton  of  Section  1,  we  let  Y*(x)  =  log{— log  Y(x)}  and 
require  that  Y*(x)  ~  if(//(x),  cr^(x));  this  implies  that  Y(x)  must  have  a  double- 
lognormal  distribution  with  parameters  Mx)  and  a  (x).  The  density  function  of  this 
distribution  is  flexible  enough  to  represent  a  variety  of  subjective  opinions  on  \  (x); 
when  CT^lx)  is  small  the  mean  of  Y(x)  is  exp( — exp(/2(x)),  and  so  is  its  median. 
However,  since  we  have  assumed  that  the  relationship  between  the  dose  and  the 
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response  is  of  the  forin  E(Y(x))  =  exp( — ot.(x)x  ),  it  follows  that  fiix)  logotCx) 

4  /3(x)logx  =  E(Y*(x)).  The  above  therefore  prompts  us  to  write,  as  a  model  of 
observations  the  relationship 


Y*(xj)  =  [1,  logxj] 


+  * 


where  ('),  iS)j  =  (7j»  0^)'  with  7j  =  loi(Xj),  0j  —  ^ 

For  the  system  equation  of  the  Kalman-Filter,  we  propose  the  steady  model 


(7,  0)'j  =  (7,  +  Wj 

with  w-  ~  J^(0,  W  ).  The  quantities  a^(Xj)  and  W:  have  to  be  specified  by  us;  some 
J  J  j  j 

hints  of  choosing  these,  and  other  related  matters  are  given  in  Meinhold  and 
Singpurwalla  (1987).  Once  the  above  have  been  done,  an  application  of  the  Kalman- 
Filter  mechanism  proceeds  routinely. 
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